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Adaptive pre-processing method for motion estimation 

FIELD OF THE INVENTION 

5 The present invention relates to a method of processing an input digital video signal 

comprising video frames for providing a modified digital video signal to a motion estimation 
step. The present invention relates also to a device corresponding to said method of 
processing. 

Such a processing method may be used, for example, as a pre-processing before an 
10 MPEG-2 or an MPEG-4 video encoding, 

BACKGROUND OF THE INVENTION 

A processing device of the above kind is described in the US patent n°5 / 990 / 962. 
Said processing device is used in a video encoding apparatus and comprises a motion 
15 compensation prediction estimating circuit for detecting a change from a current picture and 
a past picture to generate change data and a filter for deforming the current picture in 
accordance with the change data generated by the motion compensation prediction 
estimating circuit such that a deformed current picture is sent to a motion compensation 
prediction encoding section of the video encoding apparatus in order to be encoded. 

20 

SUMMARY OF THE INVENTION 

It is an object of the invention to provide a method of processing an input digital 
video signal which is both easy to implement and cost-effective. The invention takes the 
following aspects into consideration. 
25 The processing method according to the background art is rather complex as it 

needs both a comparison operation of a current picture with a past picture to generate 
change data and a filtering operation for deforming the current picture in accordance with 
the change data. Said operations of comparison and filtering are expensive in terms of 
memory capacity and central processing units (CPU) burden. 
30 To solve this problem, the processing method in accordance with the invention is 

characterised in that it comprises the following steps of : 

computing a histogram of original values associated with pixels belonging to a video 
frame, 

analysing the histogram for providing histogram parameters, and 
35 - correcting the original pixel values from the histogram parameters for providing modified 
pixel values thus giving the modified digital video signal intended to be used by the 
motion estimation step. 
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Said processing method is adaptive to the content of the input digital video signal 
and more particularly to the histogram of the luminance or chrominance components of a 
video frame contained in said input digital video signal. As a consequence, said method 
needs neither a knowledge of the past video frame nor a filtering step, which makes it both 
5 simple and efficient. 

Moreover, this method is particularly efficient for certain types of sequence of video 
frames such as, for example, dark sequences or sequences with a high variation of 
luminance from a given video frame to the following one, said high variation of luminance 
being caused by a flash or a fade. For these types of sequence, the usual motion estimation 
10 methods are not able to provide suitable motion vectors and the motion estimation, and as a 
consequence the encoding of the input digital video signal, is not performed properly. The 
processing method in accordance with the invention provides a modified digita video signal 
which allows the motion estimation step to determine better motion vectors, ^te a 
consequence, said processing method leads to an improvement of the compression 
15 efficiency and of the image quality. 

These and other aspects of the invention will be apparent from and elucidated with 
reference to the embodiments described hereinafter. 



BRIEF DESCRIPTION OF THE DRAWINGS 

20 The present invention will now be described, by way of examples, with reference to 

the accompanying drawings, wherein : 

Fig, 1 represents a block diagram corresponding to a processing method in accordance 
with the invention, 

Fig. 2a shows the evolution of a luminance histogram for a sequence in which a flash 
25 occurs, 

Fig. 2b shows the evolution of a luminance histogram for a sequence containing a fade 
to dark, 

Fig. 3a shows an embodiment of a translation operation of the histogram in accordance 
with the invention, 

30 - Fig. 3b is a particular case of the previous embodiment where the histogram is divided 
into two portions, 

Fig. 4 shows an embodiment of a width variation operation of the histogram in 
accordance with the invention, 

Fig. 5 shows an embodiment of a combination of a translation operation with a width 
35 variation operation of the histogram in accordance with the invention, 

Fig. 6 shows the evolution of the histogram after a correction step and a filtering step in 
accordance with the invention, and 
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Fig. 7 represents a block diagram corresponding to an encoding method in accordance 
with the invention. 

5 DETAILED DESCRIPTION OF THE INVENTION 

The present invention relates to a method of processing an input digital video signal 
(IS) for providing a modified digital video signal (MS) to a motion estimation step (ME). The 
aim of the motion estimation step is to compute motion vectors between two video frames. 
Due to certain types of sequences of video frames, such as sequence with a high variation of 
10 the luminance values from a video frame to another one, the motion estimation step is not 
able to provide suitable motion vectors. 

The processing method in accordance with the invention is adaptive to the content 
of the input digital video signal in order to provide a modified digital video signal and allows 
an improvement of the motion vectors estimation. 
15 Fig. 1 represents a block diagram corresponding to the processing method. Said 

processing method comprises the steps of : 

computing (HIS) a histogram (h) of original values associated with pixels belonging to a 
video frame contained in the input digital video signal, 
analysing (ANA) the histogram for providing histogram parameters (hp), and 
20 - correcting (COR) the original pixel values from the histogram parameters for providing 

modified pixel values thus giving the modified digital video signal intended to be used by 
the motion estimation step. 

The processing method may also comprise, if necessary, a step of filtering (FIL) the 
modified digital video signal for providing a filtered modified digital video signal (FMS) to the 
25 motion estimation step. 

In the preferred embodiment, the processing method is based on the calculation of 
a histogram of luminance values associated with pixels belonging to a video frame. A 
luminance histogram is a representation of the accumulation of luminance pixels in a video 

30 frame for each luminance value from 0 to 255. 

It should be noted that the computing step can be applied to the chrominance 
values associated with pixels or a combination of the luminance and chrominance values 
without going beyond the scope of the invention. In this preferred embodiment, the 
computing step is also applied to the whole video frame but it can also be applied to a 

35 portion of said video frame, for example a half of the video frame, in order to save memory 
cost. 



Once the luminance histogram has been provided by the computing step, the 
processing method aims at analysing said histogram to decide which type of correction to 
perform and when it has to be performed, which makes it adaptive to the content of a video 
frame. A temporal analysis of the histograms corresponding to consecutive video frames 
shows the luminance evolution of a sequence of video frames and allows to detect the video 
frames where a usual motion estimation method will be inefficient. Fig. 2a and 2b show the 
evolution of a luminance histogram for two specific sequences of video frames, a sequence 
in which a flash occurs, and a sequence attaining a fe^ to dark, respectwel^. 

It can be observed in Fig. 2a that the luminance histogram (h(t+l)) of a video frame 
where a flash occurs, operates a translation movement towards the high luminance values 
compared to the histogram (h(t)) of the previous video frame without the flash. On the 
contrary, it can be observed in Fig. 2b that the luminance histogram (h(t+i)) of a video 
frame contained in a video sequence with a fade to dark operates a translation movement 
towards the low luminance values compared to the histogram (h(t)) of the previous video 
frame of said sequence. Moreover, it can be observed in both cases that the width of the 
luminance histogram (h(t+l)) of a video frame is shortened compared to the histogram 
(h(t)) of the previous video frame of the same sequence. 

To overcome these problems, a correction step of the luminance values is necessary. 
The correction step of the processing method in accordance with the invention is 
implemented using two simple operations. 

The first operation corresponds to a translation of the histogram of the luminance as 
described in Fig. 3a and 3b. According to this translation sub-step, the original luminance 
value Y(x,y,t) of a pixel (x,y) belonging to a current video frame F(t) operates a translation 
of a coefficient kt giving a modified luminance value Y(x,y,t), as follows : 

V(x,y,t) = Y(x,y,t) + kt 

Fig. 3a shows an embodiment of a translation operation (tr) according to the 
invention. The mean value of the luminance over the current video frame is equal to M. The 
original luminance values Y(x,y,t) of pixels belonging to said video frame are then translated 
in such a way that the mean value of the modified luminance values Y'(x,y,t) over the 
current video frame becomes NT. As a consequence, kt is equal to the difference between M' 
and M. In a specific embodiment of the invention, M' is equal to 128 or is close to this 
particular value in order to centre the luminance histogram h'(t) corresponding to the 
modified luminance values Y^x^t). 

Fig. 3b shows another specific embodiment where M' is equal or dose to zero. In 
that particular case, the modified luminance value Y'(x,y,t) computed by the translation sub- 
step (tr 1 ) can be negative. When said modified luminance value Y'(x,y,t) is negative, a fixed 
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translation of 256 is performed in order to keep the modified luminance value Y'(x,y,t) into 
the range [0-255], The result is a histogram divided into two portions. 

In the same manner, if the modified luminance value Y'(x,y,t) computed by the 
translation sub-step (tr) is higher than 255, a fixed translation of -256 is applied to keep the 
5 modified luminance value Y*(x,y,t) into the range [0-255]. 

The second operation corresponds to a width variation (cd) of the luminance 
histogram which can be either a dilation or a contraction of said histogram. Fig. 4 shows an 
example of a dilation operation of the histogram in accordance with the invention. According 
10 to this width variation sub-step, the original luminance value Y(x,y,t) of a pixel (x,y) 

belonging to a current video frame F(t) is multiplied with a coefficient kw giving a modified 
luminance value Y'(x,y,t), as follows : 

Y'(x,y,t) = kw.(Y(x,y,t) - M) + M 

where M is the mean of the original luminance values over the whole video frame. 

15 If the coefficient kw is greater than 1 we have a dilation of the luminance histogram 

otherwise we have a contraction of the histogram. Such an operation is particularly 
advantageous in the case of a dilation when the initial width of the histogram is defined by 
the interval [el,e2] and becomes after the dilation operation a modified interval [e'l,e'2]. 
The modified luminance values of the pixels are then spread in a much larger range and the 

20 computing of motion vectors by a motion estimation method will be facilitated. In the 
preferred embodiment the coefficient kw is computed as follows : 



where [e'1,6'2] is the modified luminance value interval determined, for example, by 
the user. 

25 Said coefficient kw can also be fixed by the user or by any other method without 

going beyond the scope of this invention. 

In the same manner as in the translation sub-step, the modified luminance value 
Y , (x,y,t) is kept into the range [0-255]. 

30 Both operations of translation (tr) and width variation (cd) can also be combined in 

order to have a more efficient correction. Fig. 5 shows an example of a combination of a 
translation operation with a dilation operation of the histogram in accordance with the 
invention. According to these operations, the original luminance value Y(x,y,t) of a pixel 
(x,y) belonging to a current video frame F(t) is multiplied with a coefficient kw and the result 

35 is translated of a value NT giving a modified luminance value Y'(x / y,t), as follows : 
Y'(x,y,t) = kw.(Y(x,y,t) -M) + M' 



where M is the mean of the original luminance values over the whole video frame 
and M' is the mean of the modified luminance values over the whole video frame 
determined by the user. 

It should be noted that more complex operations can also be imagined other than 
the ones described as examples in the present invention without going beyond the scope of 
the invention. 

Finally a filtering step can be performed, more especially after a dilation^ operation of 
the histogram. This is particularly useful when the coefficient kw is higher than 2. In that 
case, the histogram is discontinuous, the accumulation of luminance pixels for certain 
luminance value being equal to zero as shown in Fig. 6, and the filtering step allows to 
smooth the histogram curve, by using, for example, an interpolation filter. 

Such a processing method is implemented in an integrated circuit, which is intended 
to be integrated into, for example, a video encoder. 

The present invention relates also to a method of encoding an input digital video 
signal (IS) for providing an encoded digital video signal (ES). 

Fig. 7 represents a block diagram corresponding to said encoding method, which 
comprises the steps of : 

pre-processing (PP) an input digital video signal (IS) for providing a modified digital 
video signal (MS), 

estimating motion (ME) from the modified digital video signal for providing motion 
vectors (MV), 

compressing (DC) the input digital video signal from the motion vectors for providing an 
encoded digital video signal (ES), 

The encoding method in accordance with the invention is such that the pre- 
processing step comprises the following sub-steps of : 

computing (HIS) a histogram (h) of original values associated with pixels belonging to a 
video frame, 

analysing (ANA) the histogram for providing histogram parameters (hp), and 
- correcting (COR) the original pixel values from the histogram parameters for providing 

modified pixel values thus giving the modified digital video signal intended to be used by 

the motion estimation step. 

Finally, the present invention relates to a video encoder corresponding to the above 
described method of encoding. 
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It will be obvious that the verb "comprise" does not exclude the presence of other 
steps or elements besides those listed in any claim. Any reference sign in the following 
claims should not be construed as limiting the claim. 
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CLAIMS 

1. A method of processing an input digital video signal (IS) comprising video frames for 
providing a modified digital video signal (MS) to a motion estimation step (ME) characterised 
in that said processing method comprises the following steps of : 

computing (HIS) a histogram (h) of original values associated with pixels belonging to a 
video frame, 

analysing (ANA) the histogram for providing histogram parameters (hp), and 
correcting (COR) the original pixel values from the histogram parameters for providing 
modified pixel values thus giving the modified digital video signal intended to be used by 
the motion estimation step. 

2. A method of processing as claimed in claim 1, characterised in that the analysis step 
(ANA) comprises a sub-step of calculating a translation parameter of the histogram and the 
correction step is intended to provide the modified pixel values from a sum of the original 
pixel values and the translation parameter. 

3. A method of processing as claimed in claim 1, characterised in that the analysis step 
(ANA) comprises a sub-step of calculating a width variation parameter of the histogram and 
the correction step is intended to provide the modified pixel values from a product of the 
original pixel values and the width variation parameter. 

4. A method of processing as claimed in claim 3, characterised in that it comprises a 
step of filtering (RL) the modified digital video signal (MS) for providing a filtered modified 
digital video signal (FMS) to the motion estimation step. 

5. A method of encoding comprising the steps of : 

pre-processing (PP) an input digital video signal (IS) for providing a modified digital 
video signal (MS), 

estimating motion (ME) from the modified digital video signal for providing motion 
vectors (MV), 

compressing (DC) the input digital video signal from the motion vectors for providing an 
encoded digital video signal (ES), 
characterised in that the pre-processing step comprises the following sub-steps of : 

computing (HIS) a histogram (h) of original values associated with pixels belonging to a 
video frame, 

analysing (ANA) the histogram for providing histogram parameters (hp), and 
correcting (COR) the original pixel values from the histogram parameters for providing 
modified pixel values thus giving the modified digital video signal intended to be used by 
the motion estimation step. 

6. A video encoder comprising : 



- a pre-processing device (PP) for receiving an input digital video signal (IS) and for 
providing a modified digital video signal (MS), 

- a motion estimator (ME) for receiving the modified digital video signal and for providing 
motion vectors (MV), 

- a data compressor (DC) for receiving the input digital video signal and for providing an 
encoded digital video signal (ES) from the motion vectors, 

characterised in that the pre-processing device comprises : 

belonging to a video frame, 

- means for analysing (ANA) the histogram in order to provide histogram parameters (hp), 
and 

- means for correcting (COR) the original pixel values from the histogram parameters and 
intended to provide modified pixel values thus giving the modified digital video signal to 
the motion estimator. 

7. A computer program product for a video encoder that comprises a set of 
instructions, which, when loaded into the video encoder causes the video encoder to carry 
out the processing method as claimed in claims 1 to 4. 
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Adaptive pre-processing method for motion estimation 
ABSTRACT 

The present invention relates to a method of processing an input digital video signal 
5 (IS) for providing a modified digital video signal (MS) to a motion estimation step (ME). Said 
processing method comprises the following steps of : 

- computing (HIS) a histogram (h) of original values associated with pixels belonging to a 
video frame contained in said input digital video signal, 

- analysing (ANA) the histogram for providing histogram parameters (hp), and 

10 - correcting (COR) the original pixel values from the histogram parameters for providing 

modified pixel values thus giving the modified digital video signal intended to be used by 
the motion estimation step. 
This processing method may also comprise, if necessary, a step of filtering (FIL) the 
modified digital video signal for providing a filtered modified digital video signal (FMS) to the 
15 motion estimation step. 

Such a processing method is adaptive to the content of the input digital video signal and 
allows the motion estimation step to provide better motion vectors for encoding purpose. 

Use: video encoder 

20 Reference: Fig. 1 
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